5 APPARATUS FOR AND METHOD OF EDGE ENHANCEMENT IN IMAGE 

PROCESSING 

CROSS-REFERENCE TO RELATED APPLICATION 

10 This application claims to benefit of Korean Patent 

Application No. 2003-54648, filed August 7, 2003, in the 
Korean Intellectual Property Office, the disclosure of 
which is incorporated herein by reference. 

* 15 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to apparatus for and 
20 method of performing edge enhancement in a widely used 
popular digital camera, such as a portable digital camera, 
having a low number of image pixels, and more 
particularly, to edge enhancement apparatus and method to 
simultaneously perform both an edge enhancement operation 
25 and an interpolation operation without any additional 
circuit or block for edge enhancement. 

Description of the Related Art 

30 In a portable digital camera or a widely used 

popular digital camera, a sensed image is not vivid since 
an image sensor and a lens are small in size, and a 
function of an image processing IC has been too much 
simplified for a cost reduction. In particular, a boundary 

35 of the sensed image becomes blurred. In order to prevent 
the sensed image from being blurred, an edge enhancement 
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method has been employed in the digital camera to enhance 
the boundary of the sensed image to obtain a vivid sensed 
image . 

5 An edge of the sensed image contains information 

about the sensed image itself- The edge of the sensed 
image represents the boundary at which a position, a 
shape, and a size of an object of the sensed image are 
changed. The edge of the sensed image is disposed on a 
10 point at which the brightness of the sensed image is 
changed from a high brightness level to a low brightness 
level or from the low brightness level to the high 
brightness level. 

15 As described above, the edge enhancement method is 

used to obtain the vivid sensed image in the widely used 
popular camera having a number of image pixels less than a 

~ 4 ^ ^-J 7\ ^-v >-> t> v> i -i-mV> /-s -v~ /-\ -F ^/-Ir-co nnln an roTTionf- m f- In r\ r\ «? . a 

O LQliU.ai.U • muvjuy ilUUU/X-J. V> J_ w^^jw v-*** w w*»»w — — f — 

method of detecting an edge of an original image using 
20 various methods and adding the detected edge to the 
original image to enhance the edge of the original image 
has been widely used. 

The edge enhancement method is classified into one 
25 of various methods according to a kind or type of an input 
image, and a fastest and simplest edge enhancement method 
is to calculate pixel data of a center pixel and adjacent 
pixels of the center pixel to determine a maximum value. 
This method is one of a homogeneity operator method and a 
30 difference operator method. 

FIGS. 1A and IB show views explaining conventional 
homogeneity operator and difference operator methods, 
respectively. As shown in FIG. 1A, the homogeneity 
35 operator method includes forming a window having 3x3 
pixels, subtracting pixel values of adjacent pixels 
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disposed around of a center pixel of the window from a 
pixel value of the center pixel to obtain differences, and 
outputting a maximum absolute value among absolute values 
of the differences as an output value. Since the 
5 homogeneity operator method performs obtaining the 
differences between the pixel value of the center pixel 
and the pixel values of the adjacent pixels of the window, 
8 subtracting operations are required with respect to the 
center pixel of the window . 

10 

As shown in FIG. IB, the difference operator method 
includes obtaining a first difference between pixel values 
of an upper left pixel and a lower right pixel of a center 
pixel, obtaining a second difference between pixel values 

15 between an upper center pixel and a lower center of the 
center pixel, obtaining a third difference between pixel 
values of an upper right pixel and a lower left pixel of 
the center pixel, and. obtaining a fourth difference 
between pixel values of a middle left pixel and a middle 

20 right pixel of the center pixel. Since the difference 
operator method requires 4 subtracting operations with 
respect to the center pixel, the difference operator 
method is faster than the homogeneity operator method in 
performing the subtracting operation. 

25 

The above-described homogeneity and difference 
operator methods are performed with respect to a 
black/white image having a brightness component. 

30 Various edge detecting methods are used for a color 

image which is not the black/white image. Generally, in 
the color image having an RGB (R, G, and B components) 
space, operations are performed with respect to the pixel 
values of each color components of R, G, or B, and a gray 

35 scale edge map is produced from operation results using 
the following formula 1. 
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= \/ G 1 red + G 2 g reen+ ^ blue 

<Formula 1> 

Here, G re d represents a pixel value of a red 
5 component, G gree n represents the edge map of a green 
component, and G b i ue represents the edge map of a blue 
component - 

However, in an HSV (hue, saturation, and value 
10 (brightness or luminance) components) space, the edge of 
the color image is detected from the value (V) component 
among the hue (H) , saturation (S) , and value (V) 
components. Therefore, it is possible to detect the edge 
of the color image by using the value (V) component rather 
15 than all color components, such as the H, S, and V 
components, 

FIG. 2 shows a block diagram of a conventional edge 
detector detecting the edge of the color image using a 

20 luminance component. Referring to FIG. 2, the sensed image 
sensed by an image sensor 201 is stored in a memory 202 as 
a Bayer pattern. Since 3 or more data components are 
required to realize the color image, pixel values of three 
independent color (R, G, and B) components) can be used as 

25 the data components. The image sensor 201 sensing the 
color image requires a color filter array (CFA) in which 
color sensors are arranged. In each color sensor of the 
image sensor 201, the pixel value of one of the color 
components is extracted with respect to each pixel, other 

30 color components of the pixel, which is not extracted with 
respect to the pixel, can be calculated through the CFA 
using information of adjacent pixels of the pixel. This 
method is a generally known Bayer pattern method 
corresponding to a CFA method. Restoring the color image 
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through the image sensor 201 having the CFA is called 
interpolation and demos icing. 

The sensed image (image information) stored in the 
memory 202 is processed to a RGB pattern image in a 3x3 
line interpolation unit 203. 

Assuming that the interpolation unit 203 performs a 
3x3 line interpolation method with respect to the image 
information stored as the Bayer pattern in a unit of a 3x3 
window having the number of 3x3 pixels, since the Bayer 
pattern is one of four patterns, the 3x3 window is one of 
the following four patterns. 

00 : rgrgrg. . . . 

gbgbgb .... 

01 • bgbgbg . ... 

grgrgr. . . . 

10 : gbgbgb. . . . 

rgrgrg. . . . 

11 : grgrgr. ... 

bgbgbg. . . . 

When a 3x3 line Bayer pattern which is shown in FIG. 
3A is provided to the interpolation unit 203, RGB values 
of the RGB pattern are as follows. 

R = (Rl + R2 + R3 +R4) /4 
G = (Gl + G2 + G3 + G4) /4 
B = Bl 



When the 3x3 line Bayer pattern which is shown in 
FIG. 3B is provided to the interpolation unit 203, the RGB 
values of the RGB pattern are as follows. 

5 R = (Rl + R2 ) / 2 

G = G3 

B = (Bl + B2) /2 

When the 3x3 line Bayer pattern which is shown in 
10 FIG. 3C is provided to the interpolation unit 203, the RGB 
values of the RGB pattern are as follows. 

R = (Rl + R2) /2 
G = G3 

15 B = (Bl + B2) /2 

When the 3x3 line Bayer pattern which is shown in 
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values of the RGB pattern are as follows. 
R - Rl 

G = (Gl + G2 + G3 + G4) /4 
B = (Bl + B2 + B3 + B4) /4 

25 The 3x3 line Bayer pattern interpolation method may 

include a method of obtaining a mean of pixel values of 
the adjacent pixels excluding the pixels having maximum 
and minimum pixel values as well as the above-described 
method. In order to perform the 3x3 line interpolation 

30 method, 3 line data should be simultaneously transmitted 
to an image processor. 

The RGB pattern image interpolated in the 
interpolation unit 203 is processed in an edge detector 
35 206 through YCrCb(YUV) pattern converter 204 and another 
memory 205. 



However, when the interpolation and the edge 
enhancement are processed on the sensed image using the 
above conventional methods to realize an image processed 
5 block, a time delay occurs between an input image and an 
output image since the interpolation and the edge 
enhancement are performed in a unit of a frame, and also a 
frame buffer and an additional memory are required to 
temporarily store the input image and the edge map, 
10 respectively, since the interpolation and the edge 
enhancement are performed in a unit of a frame. 

The sensed image is not vivid since functions of an 
image processor IC is too much simplified to sense a clear 
15 image as the input (sensed) image due to cost reduction, 
and the image sensor and a lens of the digital camera 
having a low number of pixels are small in size. 
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sensed image becomes blurred. Although the edge of the 
20 object of the sensed image can be enhanced using the 
conventional edge enhancement method to obtain a more 
vivid image, an edge enhancement apparatus employing the 
conventional edge enhancement method requires an 
additional function unit (block) in addition to an 
25 interpolation processing unit (block) as shown in FIG. 2. 

Japanese patent laid-open No. hei7-107268 discloses 
a conventional image processing apparatus for obtaining 
high resolution information for a sharp edge by 
30 calculating the high resolution information adjacent 
resolution information in a linear interpolation unit and 
by adding edge information of an edge information unit to 
linear interpolated high resolution information. 

35 However, since the above conventional image 

processing apparatus is an apparatus for processing an 



7 



edge processing operation after the interpolation has been 
performed, the additional function block is required in 
addition to the interpolation block. Moreover, the above 
conventional image processing apparatus cannot be properly 
5 employed in the digital camera or the widely known popular 
digital camera. 

A new method of simultaneously perform the edge 
enhancement and the interpolation without any additional 
10 function block needs to be easily employed in the digital 
camera or the widely known popular digital camera 
regardless of the size or the cost of the image processing 
IC. 

15 SUMMARY OF THE INVENTION 

In order to solve the above and/or other problems, 
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enhancement apparatus and method to obtain a more vivid 

20 image by providing a simple circuit enhancing an edge of 

an image to the apparatus without increasing an image 
processing unit in size. 

It is another aspect of the present invention to 
25 provide edge enhancement apparatus and method to enhance 
an edge of an image without providing any line memory 
additional memory to store an input image, which is 
required when an edge enhancement is realized using 
additional function block, and an edge map, respectively. 

30 

It is another aspect of the present invention to 
provide edge enhancement apparatus and method to 
simultaneously processing 3x3 interpolation and edge 
enhancement to output an output image with only a few 
35 clocks delay without a maximum frame delay, which occurs 



when interpolation and edge enhancement blocks are 
realized in separate circuit blocks . 

Additional aspects and/or advantages of the 
5 invention will be set forth in part in the description 
which follows and, in part, will be obvious from the 
description, or may be learned by practice of the 
invention . 

To achieve the above and/or other aspects of the 
present invention, an apparatus for simultaneously 
performing edge detection and enhancement includes an 
image sensor sensing an image to output image data, a line 
buffer receiving the image data to output the image data, 
a register storing the image data transmitted from the 
line buffer, an interpolation unit performing an 
interpolation operation on the image data received from 
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detection operation on the image data received from the 
register to output an edge detection value in parallel to 
the interpolation operation of the interpolation unit 
according to a selection signal representing a pattern of 
the image data stored in the register, and an edge 
enhancement unit enhancing an output of the interpolation 
unit according to the edge detection unit of the edge 
detection unit* 

According to another aspect of the present 
invention, a method of simultaneously performing edge 
30 detection and enhancement includes sensing an image to 
output image data, receiving the image data to output the 
image data in a line buffer, storing the image data in a 
register, performing an interpolation operation on the 
image data received from the register, performing an edge 
35 detection operation on the image data received from the 
register to output an edge detection value in parallel to 
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the interpolation operation according to a selection 
signal representing a pattern of the image data, and 
enhancing an output of the interpolation operation 
according to the edge detection value. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other advantages of the invention will 
become apparent and more readily appreciated from the 
10 following description of the preferred embodiments, taken 
in conjunction with the accompanying drawings of which: 

FIGS. 1A and IB show views explaining conventional 
homogeneity operator and difference operator methods, 
15 respectively; 

FIG. 2 shows a block diagram of a conventional edge 
detector detecting an edge using a luminance component; 

FIGS. 3 A through 3D show 3x3 windows formed when a 
Bayer pattern is interpolated using a 3x3 line 
20 interpolation method; 

FIG. 4 is a block diagram of an edge enhancement 
apparatus according to an embodiment of the present 
invention; and 

FIG. 5 is a block diagram of another edge 
25 enhancement apparatus according to another embodiment of 
the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

30 Reference will now be made in detail to the present 

preferred embodiments of the present invention, examples 
of which are illustrated in the accompanying drawings, 
wherein like reference numerals refer to the like elements 
throughout. The embodiments are described below in order 

35 to explain the present invention by reference to the 
figures . 
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According to an aspect of the present invention, 
edge enhancement method and apparatus includes a method of 
detecting an edge from a brightness component (luminance 
5 component) of image data and enhancing the edge as a 
simplest method among various edge detection methods and 
enhancement methods. Since most edges shows the same edge 
as the luminance component, the edge is detected and 
enhanced using the luminance component. 

10 

The luminance component corresponds to Y of a YCrCb 
or YUV space. According to CCIR-6-1 YCrCb color space 
conversion formula, G component among R, G, B components 
is most significant to Y since a coefficient of R is 77, a 
15 coefficient of G is 150, and a coefficient of B is 29. 
Therefore, Y of the YCrCb space or G component of an RGB 
color space can be used as the luminance component to 



20 <CCIR-6-l YCrCb color space conversion formula> 

Y = (77R + 150G + 29B) / 256 Range: 16 ~ 235 

Cb = (-44R - 87G + 131B) / 256 + 128 Range: 16 ~ 240 

Cr = (131R - HOG - 21B) / 256 + 128 Range: 16 ~ 240 

25 

In the method of detecting the edge using the 
luminance component, if an image sensor contains an image 
processor to output RGB data, such as YUV data, processed 
in an interpolation operation, it is desirable that the 

30 edge is detected using the luminance component, such as Y, 
of each pixel. If the RGB data which has not been 
processed in the interpolation operation is outputted, an 
RGB format of the RGB data needs to be converted into a 
YCrCb or YUV format so as to detect the edge from the RGB 

35 data in the image sensor which do not contain the image 



11 



processor. In this case, an additional memory space is 
needed to be used in an edge detection process. 

Since the edge enhancement method and apparatus 
5 perform the interpolation and the edge enhancement in a 
simplest structure in a small-sized image device which can 
be connected to a mobile device, such as a wireless phone 
according to an aspect to another aspect of the present 
invention, the method of detecting and enhancing the edge 
10 using the G component which mostly affect the luminance 
component, is employed in the edge enhancement method and 
apparatus . 

The edge detection method used in the edge 
15 enhancement method and apparatus compares a G value of a 
center pixel of a 3x3 window included in a frame with G 
values of adjacent pixels of the center pixel to detect 
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center pixel and the G values of the adjacent pixels. 

20 

As shown in FIGS. 3A through 3D, with respect to 3x3 
windows of 4 different Bayer patterns, the edge is. 
detected by comparing the G value of the center pixel of 
the 3x3 window with the G values of the adjacent pixels of 
25 the center pixel and by obtaining a maximum difference 
among the differences between the G value of the center 
pixel and the G values of the adjacent pixels as the edge. 

The edge enhancement method and apparatus perform 
30 detecting and enhancing the edge simultaneously according 
to another aspect of the present invention. The edge 
enhancement operation is not performed on the image data 
to be enhanced. The G value of the center pixel and the 
four G values of the four adjacent pixels are compared 
35 since one of the RGB components exists in the Bayer 
pattern. 
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FIGS. 3A and 3D show the center pixel having a B 
value and an R value, respectively, rather than the G 
value. Since the G value is data generated from the 
5 interpolation based on the B and R values, the G values is 
not data outputted from the image sensor but calculated 
data obtained from the interpolation of the B and R 
values. Accordingly, the edge is not calculated in FIGS. 
3A and 3D. 

10 

In FIGS. 3B and 3C, a multiplication value obtained 
by multiplying 4 to the G value of the center pixel is 
subtracted from a sum of G values of the four adjacent 
pixels to calculate an edge detection value (signal) X, 
15 which is obtained from the following formula 2. 

Edge detection value (X) = 4G3 - (G1+G2+G3+G4 ) 

"V i_ J.JLLLUXU <— 

20 Here, the G value of the center pixel is multiplied 

by four since the number of the adjacent pixels is four. 
If the edge does not exist in a portion surrounded by the 
3x3 window, the G values disposed in the 3x3 window are 
similar to each other, and a difference between the 

25 multiplication value and the sum is close to zero. That 
is, the detection value X becomes zero. To the contrary, 
if the edge exists in the 3x3 window, one of the G values 
of the adjacent pixels is greater than other G values due 
to differences of the luminance components, and an 

30 absolute value of the difference between the 
multiplication value and the sum becomes significant to 
show that the edge exists in the 3x3 window. 

Even if the edge detection value X is detected from 
35 a point disposed adjacent to the center pixel, the above 
edge method can be used in the edge enhancement apparatus 
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since there is no significant effect on an edge-enhanced 
image unless the image is enlarged or minimized and since 
another aspect of the present invention is to realize the 
edge enhancement in a most simplest manner. 

5 

In this case, a threshold value can be set. If the 
edge detection value X is greater than the threshold 
value, it is determined that there exists the edge in the 
3x3 window. If the edge detection value X is not greater 
10 than the threshold value, it is determined that the edge 
does not exist in the 3x3 window. 

The edge detection method and apparatus according to 
another aspect of the present invention realize the edge 
15 detection and the edge enhancement using a line memory 
used to perform a 3x3 interpolation operation in the edge 
enhancement without any additional memory. 

FIG. 4 is a block diagram of the edge enhancement 
20 apparatus according to an embodiment of the present 
invention. An operation of the edge enhancement will be 
described in detail in reference with FIG. 4. 

As shown in FIG. 4, image data of a sensed image 
25 having pixel lines in a unit of a frame is outputted from 
an image sensor 415 to a line buffer 401. The line buffer 
401 temporarily stores the input image data and outputs 
the stored image data in a unit of 3 lines for the 
interpolation. The 3 line image data is inputted to an 
30 interpolation unit 403 through a register 402. 

An output of the line buffer 401 is transmitted to a 
left terminal of the register 402 and then shifted to a 
right terminal of the register 402. Accordingly, the image 
35 date corresponding to the 3x3 window is stored in the 
register 402, and the 3x3 window is shifted through the 
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register 402 according to each clock. The 3x3 window is 
shifted rightward according to the clock to be inputted to 
the interpolation unit 403. 

5 The interpolation unit 403 performs the 3x3 line 

interpolation on the image data of pixel values 
corresponding to 9 pixels received from the register 402 
as described above. 

10 An RGB to YCrCb conversion unit 404 converts the RGB 

data, which is interpolated in the interpolation unit 403, 
into the YCrCb format data or the YUV format data to be 
outputted to a display apparatus or a storage unit. 

15 FIG. 4 shows circuits, such as a control unit 405 

and an edge detector 406, to perform, the edge detection 
and the edge enhancement. 

The control unit 405 transmits a pattern signal 
20 representing information about a pattern of the 3x3 window 
to the interpolation unit 403. The pattern signal 
representing the Bayer pattern generated from the image 
sensor 415 is transmitted to the interpolation unit 403. 

25 In a case that the image sensor 415 does not include 

the image processor, the image data transmitted from the 
register 402 to the interpolation unit 403 is the Bayer 
pattern . 

30 In this case, the Bayer pattern is one of the 

following four patterns. 

00 : rgrgrg. . . . 

gbgbgb .... 

35 
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01 : bgbgbg .... 

grgrgr. . . . 

10 : gbgbgb. . . . 
5 rgrgrg. . . . 

11 : grgrgr. . . . 

bgbgbg. ... 

10 That is, the control unit 405 transmits to the 

interpolation unit 403 the pattern signal representing 
which one of the four patterns is the Bayer pattern 
transmitted to the interpolation unit 403. 

15 When the pixel value of the center pixel 

constituting the 3x3 window stored in the register 402 is 
the G value, the G value is multiplied by 4, and the 
multiplication is subtracted from the sum of the four 
values disposed adjacent to the center pixel to generate 

20 the edge detection value X. 

The pixel value of the center pixel of the 3x3 
window is not the G value, the edge detection value X is 
not transmitted to the first adder 408. 

25 

As shown in FIG . 4, the interpolation unit 403 
receives the pattern signal from the control unit 405 to 
determine the Bayer pattern received from the register 
402. 

30 

The interpolation unit 403 generates a selection 
signal of 0 value to the edge detection unit 406 to 
disable the edge detection unit 406 when the pattern of 
the window inputted to the interpolation unit 403 shows 
35 that the pixel value of the center pixel is the B or R 
values rather than the G value as shown in FIGS. 3A and 
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3D. The interpolation unit 403 generates the selection 
signal of 1 value to an AND gate 414 of the edge detection 
unit 406 to output the edge detection value X of the edge 
detection unit 406 to a first adder 408 when the pattern 
5 of the window inputted to the interpolation unit 403 shows 
that the pixel value of the center pixel is the G value as 
shown in FIGS, 3B and 3C. 

The edge detection unit 406 performs a calculation 
10 operation on the G value Gc of the center pixel, which is 
disposed in a center portion of the 3x3 window, and Gl, 
G2, G3, G4 values of the pixels disposed adjacent to the 
center pixel. The edge detection value X is calculated by 
the following formula. 

15 

Edge detection value (X) = 4Gc - (G1+G2+G3+G4 ) 

In the calculation operation of the edge detect i on 
unit 406, a second adder 410 adds Gl to G3 to output a 

20 first sum of G1+G3, a multiplier 411 multiplies the G 
value Gc of the center pixel by 4 to output a 
multiplication value 4Gc, a third adder 413 adds G2 to G4 
to output a second sum G2+G4, and a fourth adder adds the 
first sum G1+G3, the multiplication value 4Gc, and the 

25 second sum G2+G4 to output the edge detection value X, 
that is, 4Gc - (G1+G2+G3+G4 ) . 

As described above, when the edge does not exist in 
a portion of the image data corresponding to the 3x4 

30 window stored in the register 402, the edge detection 
value X corresponding to the addition value of 4Gc - 
(G1+G2+G3+G4 ) becomes near zero, that is, the edge 
detection value (X) = 0, since all most pixel values of 
the pixels disposed in the 3x3 window are similar to each 

35 other. To the contrary, when the edge exists in the 
portion of the image data corresponding to the 3x4 window 
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stored in the register 402, an absolute value of the edge 
detection value X corresponding to the addition value of 
4Gc - (G1+G2+G3+G4 ) becomes a greater value, that is, the 
edge detection value (X) varies, since some of the pixel 
5 values of the pixels disposed around the center pixel of 
the 3x3 window are different from each other according the 
luminance component . 

The edge detection value X outputted from the fourth 
10 adder 412 and the selection signal outputted from the 
interpolation unit 403 are inputted to the AND gate 414 
for an adding operation. The interpolation unit 403 
determines the Bayer pattern based on the pattern signal 
transmitted from the control unit 405, transmits the 
15 selection signal of the 0 value to the AND gate 414 when 
the pixel value of the center pixel of the 3x3 window is 
the R or B value rather than the G value stored in the 
register 402, and transmits the selection signal of the 1 
value to the AND gate 414 when the pixel value of the 
20 center pixel of the 3x3 window is the G value. 

If the selection signal is 0, that is, a disabled 
state representing that the pixel value of the center 
pixel is the R or B value rather than the G value, the 
25 edge detection value X is not transmitted to the first 
adder 408. If the selection signal is 1, that is an 
enabled state representing that the pixel value of the 
center pixel is the G value, the edge detection value X is 
transmitted to the first adder 408. 

30 

The edge detection value X is added to an output 
Gout of the interpolation unit 403 in the first adder 408 
to enhance the output Gout. Accordingly, if the image data 
includes the edge after being interpolated, the image data 
35 is enhanced to output the enhanced value (signal) G' to 
the RGB to YCrCb (YUV) conversion unit 404 as follows. 
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G'=Gout + X 



FIG. 5 is a block diagram of another edge 
5 enhancement apparatus having an image sensor 515, a line 
buffer 501, a register 502, an interpolation unit 503, an 
RGB to YCrCb(YUV) conversion unit 504, a control unit 505, 
an edge detection unit 506, a comparison unit 507, and a 
first adder 508 according to another embodiment of the 

10 present invention. The edge detection unit . 506 includes a 
second adder 510, a first multiplier 511, a third adder 
513, a fourth adder 512, and an AND gate 514. Referring to 
FIG. 5, the control unit 505 determines a predetermined 
reference value CV corresponding to the edge detection 

15 signal X, and the edge is enhanced when the edge detection 
signal X detected in the edge detecting unit 506 is 
greater than the reference value CV. 

The block diagram of FIG. 5 is similar to the block 
20 diagram of FIG. 4 except the control unit 404 determining 
the reference value CV, the comparison unit 507 comparing 
the edge detection value X with the reference value CV, 
and a second multiplier 509. 

25 The edge detection value X outputted from the fourth 

adder 512 of the edge detection unit 506 is inputted to 
the AND gate together with a selection signal outputted 
from the interpolation unit 503 so as to perform the 
addition operation. The interpolation unit 503 determines 

30 the Bayer pattern based on the pattern signal from the 
control unit 505, transmits to the edge detection unit 506 
the selection signal of the 0 value when the pixel value 
of the center pixel of the 3x3 window is not the G value 
but the R or B value, and transmits to the edge detection 

35 unit 506 the selection signal of the 1 value when the 
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pixel value of the center pixel of the 3x3 window is the G 
value . 

When the selection signal is the 0 value, that is, 
5 when the pixel value of the center pixel of the 3x3 window 
is not the G value but the R or B value, the edge 
detection signal x is not transmitted to the comparison 
unit 507 and the first adder 508. To the contrary, when 
the selection signal is the 1 value, that is, when the 

10 pixel value of the center pixel of the 3x3 window is the G 
value, the edge detection value X is transmitted to the 
comparison unit 507 and the first adder 508, and the 
comparison unit 507 compares the reference value CV 
inputted from the control unit 505 with the edge detection 

15 signal X outputted from the edge detection unit 506 so as 
to determine the existence of the edge in the 3x3 window. 

The reference value CV outputted from the control 
unit 505 may be adjusted according to a level of the edge 

20 enhancement. If the reference value CV is set to a low 
value, a dimmed portion of the 3x3 window, that is, a 
portion having a very small change of an object of the 
image data, can be enhanced to make a blurred boundary of 
the object enhanced. If the reference is set to a high 

25 value, 

Another portion of the 3x3 window in which the image 
data is changed, the boundary of the object is enhanced to 
be vivid. A necessity of the edge enhancement varies 
30 according to kinds or usages of the image data, and the 
reference CV is adjusted according to the necessity of the 
edge enhancement. 

In a case of an 8 bit image frame, G value is one of 
35 0 through 255. Generally, the reference value is set to 
64. The edge exists when the edge detection value X is 
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greater than the reference value CV, and the edge does not 
exist when the edge detection value X is not greater than 
the reference value CV. 

5 The comparison unit 507 outputs a weight a when the 

edge exists according to a comparison result of the edge 
detection value X and the reference value CV. The weight 
outputted from the comparison unit 507 is multiplied with 
the edge detection value X outputted from the edge 

10 detection unit 506 so as to output the modified detection 
signal a-X, and the modified detection signal a-X is added 
to the G output value Gout of the interpolation unit 503 
among outputs of the interpolation unit 503. Therefore, if 
the edge exists after the pixel value is interpolated in 

15 the interpolation unit 503, the enhanced signal G' 
transmitted to the RGB to YCrCb conversion unit 504 may be 
calculated from the following formula. 



G' - G out + a-X 

As shown in the above formula, the G output value 
Gout of the interpolation unit 503 is enhanced according 
to the weight. If the weight a is set to a relatively 
large value, the edge enhancement operation is excessively 
performed so that the object of the image data is blurred. 
It is possible that the weight a is in a range between 0 
to 1. 

If it is determined that the edge does not exist 
30 according to the comparison result of the edge detection 
value X and the reference value CV in the comparison unit 
507, the comparison unit 507 outputs the 0 value which is 
multiplied by the edge detection value X in the second 
multiplier 509 so that the edge detection value X is 
35 offset. Therefore, the output Gout of the interpolation 
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unit 503 is not enhanced to be outputted to the RGB to 
YCrCb conversion unit 504. That is, G' = Gout. 



As described above, since the register 502 providing 
5 the 3 line image data to the interpolation unit 503 
performing the 3x3 interpolation is simultaneously or 
commonly used for edge detection and enhancement circuits, 
such as the control unit 505, the edge detection unit 506, 
the comparison unit 507, and the second multiplier 509, 

10 any additional memory is not necessary, nor a 
manufacturing cost is increased. Therefore, this structure 
does not affect an entire IC area of an image processing 
unit even if the above described edge detection and 
enhancement circuits are used in the image processing unit 

15 of the edge enhancement apparatus. 

According to the edge detection and enhancement 

aj^^ci j_ a. ex & , a. o j-iu^ j- v— -i- j- ^ »- ->- ^ _ w w****wv**^^ ~j — 

to obtain a vivid image without increasing the entire IC 
20 area. 



According to the edge detection and enhancement 
apparatus, if the edge detection and enhancement circuits 
are realized in a separate block (unit) in the image 
25 processing unit in order to enhance the edge of the image, 
any line memory and any additional memory required to 
store the edge map are not necessary. 

According to the edge detection and enhancement 
30 apparatus, the 3x3 interpolation and the edge enhancement 
are simultaneously performed without a clock delay 
compared to a possibility that a frame delay occurs if the 
edge detection and enhancement circuits are realized in a 
separate block (unit) in the image processing unit in 
35 order to enhance the edge of the image. 
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Although a few preferred embodiments of the present 
invention have been shown and described, it would be 
appreciated by those skilled in the art that changes may 
be made in this embodiment without departing from the 
principle and sprit of the invention, the scope of which 
is defined in the claims and their equivalent. 
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